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use of distributivity was relatively low, that ability to complete 
correctly examples of types tested tended to increase from grade four 
to five to six to seven, that "regrouping sets" examples were less 
difficult than "multiplication-addition" examples and that 
"right-distributive" examples were easier than "left-distributive" 
examples, and that pupils had only a limited tendency to respond in 
the same way across a set of examples within a test. (DT) 



f 




ERIC 



SOME FACTORS ASSOCIATED WITH PUPILS PEllFORtiANCE ON 
EXAMPLES INVOLVING SELECTED VARIATIONS OF THE DISTRIBUTIVE IDEA- 



T— « 

o 



J. F, v;eaver 
The University of Wisconsin'-Madison 



assisted by 



Marilyn N. Suydam 
The Ohio State University 



U.S DEPARTMENT OF KcALTH. 
EDUCATION & WELFARE 
OFFICE OF EDUCATION 
THIS DOCUMENT HAS BEEN REPRO- 
DUCED EXACTLY AS RECEIVED FROM 
THE PERSON OR ORGANIZATION ORIG- 
INATING IT POINTS OF VIEW OR OPIN- 
IONS STATED DO NOT NECESSARILY 
REPRESENT OFFICIAL OFFICE OF EDU- 
CATION POSITION OR POLICY 



and 



Peter Christiansen, III 
Madison Public Schools 

Charles Eugene Hobbs 
The University of Wisconsin-Madison 

Mary Jane McMaster 
The University of Wisconsin-Madison 

Waldecyr C, Pereira 
The University of Wisconsin-Madison 



Condensatior. of a report presented at the 1972 .ninm-. Meeting oi the American 
Educational Research Association (New Orleans, 27 February) in a session co- 
sponsored by Division C and the Special Interest Group for Research in Mathe- 
matics Education (SIG/RME) . 

[In this condensation, findings are summarized in tabular form without elabo- 
ration or discussion which will be incorporated in the oral presentation.] 



The reported investigation was conducted in association with the Wisconsin Re- 
search and Development Center for Cognitive Learning, supported in- part as a 
research and development center by funds from the United States Office of Edu- 
cation, Department of Health, Education, and Welfare. The opinions expressed 
herein do not necessarily reflect the position or policy of the Office of Edu- 
cation and no official endorsement by the Office of Education should be in- 
f erred. Center No. C-03/Contract 5-10-15^.. 



ERIC 

v# 



FILMED FROM BEST AVAILABLE COPY 



.4 - * - 




m m o 

O 1^ 13 

ft) fD O 

o m o 



a p* 



ft) 

R 

3 

O 

o 



a o 
o y 

•3 



;3 
o 
c/) o 



O 



o 
o 



O 
rt 

O 

K 

I 



Q 

m 
w 



.ft 

Pi' , 

a; 
p o 

(5 {/» 
Q 



O Q 
3 O 
D O 
3 



\J1 O 

u 
rr 
o 
c 



a 



o 

ct 

O (U 

o 



o 

M 

»-< 
o 



O* ct 

4 



rt m 

O O 

O V- 

H. , O 

o D 

CD CI 

o 



O 

3 5 
a H. 

ct 

rt 

:r < 



? 3 

pt * 

ct 
ft 



Q 
P 

Oh 

CD 



O 



O 
P 



IS* 

O 

o 



p 

ct) 



O 



td 

O ; 



ERIC 



o 



o 

00 

o 

o 

o 
o 
o 



CO 
fD 

CO 



O 

H5 



pi 



s 

03 



><5 



to 

M 
09 



CO a 
e a 

m CO 



f 

i> 



CD 



ERIC 



to 



O 



(D 



Ui 00 



3 

H 



P 



o 

00 
DO 

DO 

M 
CO 



oc. 



00 



o 
o 



c 



CO 

s 
-a 

M 
Q 



II 



Q 
O 

O 
B 

rf 
O 

P 
to 



to 



I 



o 

00 
CO 

CO 
CO 
CO 



+ 



Oi CD 



CO ^^ 



o 
o 

cr 
(D 

rt 

CO 

CD 



O 
O 

<-!• 
O 

(D 



Or 

w 



ERIC 



o 

00 

CO 

M 
CO 



CO 



n 
o 

B 

M 
CD 
rt- 

O 

tr 
cn 

CD 
CD 



00 



o 
o 

o 

c+ 

o 

'p 

(D 



OK) 
4^ 



FRir 



o 

00 



M 

CO 



0^ 

Ul 

(\) 

Ul 

O 
hh 

CO 



> 

n 
> 

w 



Q 

o 

o 
» 

ft 
o 

Cfq 
Q 



s 

a 

Ul 

Wi 
(D 
e+ 
CO 

O 
H» 



rl- 
CO 

O 



O 
O 

M 
O 
rl- 
(D 

tr 

(D 
X 
P 

% 

M 

CP 



ERIC 



o 

00 
Oi 



to 
to 

CO 



fi5 

a 



00 



CO 


Ul 


CO 


CD 


Q 


CD 


rf 


r+ 


ct 


CO 


CO 




0 


0 


0 


l-b 


H5 





o 
o 

I 

M 

CD 
rh 
CD 

rf 

H- 

CO 

CD 

i 

M 



Q 
O 

0~ 

c+ 
O 

'P 
0 




IP 

0^ 



o 

00 



CO 





P3 












a 






M 


M 






Ol 






Cfi 


CD 


CD 


CD 




r+ 


c+ 


in 




Cfi 


0 


0 


0 




H, 


H, 










CJO... 





o 
o 

3 

M 

(T) 
rf 
Q 

rf 

Q 

B 

M 

(T) 



O 

3 . 

rh 
O 



133 

p.) 



o 

00 
00 

H 

H 
W 



Ui 

(D 
c+ 

m 

0 
Hs 

H 

(Ti 



P 

a 

00 

CO 
(D 
c+ 
CO 

0 



Q 
O 

I 

M 

e+ 
(D 

e+ 

ty 

CO 

Q 
P 

H 



O 

a 

e+ 
O 

P 
CD 
(0 



ERIC 



m 

c+ 
CO 

0 



ft) 

00 



o 

00 
(0 

H 
CO 

to 

CO 



CO 
rf 
O 

• ^ 

O 
M 
O 

Ul 
0) 

o 

>^ 

cr 
o 
o 

PT 
H 











0 






P- 






CD 


CO 




CO 


m 


(D 


(D 




rt 


c+ 


rt 


m • 


m 


m 


0 


0 


0 




Hi 


K) 




H 


H 




CO 


CO 



o 

I 

H 
CD 
c+ 

fD 

(+ 

tr 

H> 

CO 

CD 

'CJ 
H 
CD 



ERIC 



p 

CD 



1^ 






or 



M n> o to 

c: 'a 

o 1^ H* 'a 

ft) Q o o 

ct w (l> e/> 

o n> o (T> a> 

D cu ^ a P« 



O 



3* w 
o 

•3 



c/i Q 



I ct 

O ST 



3 
ct 

O 

<t> 

P2 



o 

ct 

3 

o 
ct 

O 
K 



ct 

St S 
p 

♦CJ ct 
O H> 

cn O 

Ct « 



p 



Pi p) 
5 3 



I 



a 



0 ct 

1 H- 
VJl O 

-fr 3 
cn 



o 



3 



O 
3 
3 O 
3 

o (1> 

a> 3 

3 ct 
ct 

iD O 

3 
ct 



O 

VI 

it 

ct 



ct 
3* 

fD O 

O H. 
(D It 



JX ct H- 



ct « 

p 

ct 
(D 
CO 



o 

.CD 



CO 
CO 



o 

o 
o 



CD 



o 



«<3 



o 
o 
o 
o 



CO 



O 
t-b 



'a 



i 



+ 



CO 
CO 



to 



p a 

O 2 
Cfi CO 



ERIC 



CO 



p 



to 



o 

> 



P 
£3 

a. 





cn 






CO 


CQ 


o 


(D 


CD 




c+ 


c+ 






Ul 


o 


O 


O 


Hi 


Ms 


K) 










00 


CD 



o 
o 

M 

CD 

c+. 

CD 

rt- 

cn 

CD 

M 

CD 



O 
00 



ERIC 



0 



to 



CD 
rf 

m 
o 

Hi 



CO 

CO 
CD 
c+ 
CO 

o 



§ 

CD 
rf 
CD 

rf 

0} 
CD 

CD 



O 
» 

rf 
O 

P 
CD 
CO 



FRir 



p 

CD 

CO 

CO 
CD 
rf 
CO 

O 

H3 



P 

CD 

to 



CO 
M 

to 



CD 
O 



o 
o 

. 3 
t3 
M 
CD 
rf 
O 

rf 

H* 

Cfl 

CD 

3 



p 



en 

CO 
CD 

o 



CD 



EKLC 



o 

o 

!P 

CD 



CD 
r+- 

O 



CD 
CO 



CO 



& 



o 

i 

M 

CD 

0 

■ tr 

03 
0 

M 

0) 







t?0 


CO 


CO 


CO 




(D 


0 




c+ 


c+ 


CO 


CO 


CO 


O 


O 


O 


Ha 






M 


M 


M 




On 


Cjn 



ERIC 



o 

9 

e+ 
O 



to 

l>0 



2 



<Si 

+ 

X 
II 



5 



i 

J— 

CD 

CD 

<+ 
65* 

H- 

03 

CD 
X 

3 

M 
CD 



ERIC 



O 
O 

cs 

c+ 
O 

fi» 

on? 

CD 



03 



crq 

CD 



to 



-a 

CO 



o 

I 

M 

CD 
c+ 
CD 

ty 

H- 

W, 

CD 

n 

M 

CD 



ERIC 



o 
o 

o 
ti 

ct 

o 
I? 



p 



V 



00 
M 

to 
to 



o 

I- 

(D 
rt- 

(D 

c+ 

CO 
(D 

M 
(0 



<3^ 00 




O 
0 

c+ 
O 

crq 

0) 
CO 



00 



to 

CO 

to 

CO 



o 
o 

M 
CD 
rf 
CD 

rf 
CD 

M 

CD 



+ 



C» 00 



CO 

o 



to to 



o 

M 
O 
01 
(D 

«<s 
o 
p 

cr 
o 
o 
5»r 

M 
(D 



P 

Cfq 

CD 
CO 



Table of Contents 



Condensed text Pages 1-5 

References 6 

Footnote ^ 

Table 1. Factors and Levels Investigated^ WHAT ARE THK NUMBERS? 

Tests 01-12, Items 1-9 , 8 

Table 2. Characteristics of Test Items Relative to Levels of 

Factors A,B,C, D, E 9 

Table 3. Levels 1 and 2 of Factors A, B, C in Conjunction with 

Level 3 of Factor D , 10 

Table 4. Sources of Data, Tests 01-08 11 

Table 5. Performance Eased on Criterion Responses, Tests 01-08 ..... 12 

Table 6. Performance Based on Mathematically Correct Repponses, District 1 

[Items 1-8, Tests 01-08] .• 13 

Table 7. Performance Based on Mathematically Correct Responses, District 2 

[Items 1-8, Tests 01-08] , . . 14 

Table 8. Distribution of Categorized Pupil Responses, District 1 

[Items 1-8, Tests 01-08] 15* 

Table 9. Distribution of Categorized Pupil Responses, District 2 

[Items 1-8, Tests 01-08] 16** 

Table 10. Distribution of Pupil Responses on Item 9, Tests 01-08 X7 

Table 11. Distribution of Incorrect Responses, District 1 

[Items 1-8, Tests 01-08] , 18 

Table 12. Distribution of Incorrect Responses, District 2 

[Items 1-8, Tests 01-09] . 19 

Table 13. Summary of Chi-squar*^. Tests of Null Hypotheses, Set A 20 # 

Table 14. Summary of Cochran-Q Tests of K.ill Hypotheses, Set B 21 # 

Figure 1. Four equivalent variations of the distributivity of 

multiplication over addition for counting numbers k,p,q • • • . 22 



Appended sample Tests. # 



* Also see p. 15a for related Table 8a which has been added. 
** Also see p. 16a for related Table 9a which has been added. 

# Distributed separately from this document. 



Purpose ; To ascertain whether there existed differential achievement ef- 
fects associated with the factors and levels identified in Table ^"^s they re- 
late to two variations of d istributivity which may be symbolized as 

(k,P),(k,q) ►(k,r) and 

(P,k),(q,k)— >(r,k) 
where k, p, q, r are counting numbers such that r == p + q and where indi- 
cated ordered-pair mappings are translated into words or symbols appropriate 
to levels o£ factor A (context), Table 1. [Also see Figure.l,] 

Rationale . Sundry variations of distributivity are used in explicit or im- 
plicit ways within contemporary elementary-school mathematics programs.^ 

However, little if any systematic 
consideration appears to have been given to the possibility of differential ef- 
fects associated with some of the Table 1 factors and their potential interac- 
tions. ";his is so both for textbook material that has been prepared for ele- 
mentary-school pupils and for the limited empirical research that has been re- 
ported (e.g., Crawford, 1965; Flournoy, 1964; Gray, 1965; Schell, 1968). It 
very well may be that some of elementary-school pupils* alleged difficulty with 
"the distributive idea" is to be found in failure of mathematics programs to 
take into account conceptual differences inherent in certain of the factors and 
levels examined in the present investigation. 

Procedure . Twelve 9- item tests were constructed in accord with Table 2 to 
incorporate levels of factors A thru E identified in Table 1. (Copies of one 
of Tests 01 - 08 and one of Tests 09 - 12 are appended.) Early in the fall 
of 1972 these tests were given to intact 4th-, 5th-, 6th-, and 7th-grade 
classes from two midwestern city school districts. In each district all tests 
were administered by one person (not a regular classroom teacher), and each 
participating pupil worked with one of the 12 randomly distributed tests under 
a 12-ininute working^time limit.. Directions for completing the test items pur- 
posely avoided any mention of distributivity or its potential application. 
Pupils were instructed to progress thru the test booklets page by page (item 
by item) and were not permitted to turn back at any time to a previously com- 
pleted or attempted or omitted page (item) . 

Partial findings . The data reported here are drawn from Tests 01-08 only, 
and especially from items 1-8 of those tests. (See Table 3 and Table 4*) 

A cursory preliminary examination of completed test booklets suggested that 
it would be desirable to devise a scheme to categorize observed pupil responses. 



The scheme adopted may be illustrated in part using "(4, 8), (7, 8) — , 

to symbolize an item in r ij^ht - distribut ive form , wi th a wholly - open response 
format , whose contex t is either reRroupin^ sets or miilti plication - add it i on , and 
whose item " stem format is either horizontal or vertical; e.g., 

4 sets of 8 and 7 sets of 8 are sets of OP 



(A X 8) + (7 X 8) - ; , OR 

4 sets of 8 OR , (4x8 



For any one of these variations, some observed pupil responses and their re- 
spective codings would be: 

11 , 8 Criterion response: (p -f q) , (k)^^ Code 1 

8 , 11 Commuted criterion response: (k) , (p + q) Code IC 

2 , 44 Some other mathematically correct response, (a,b), 

where ab = k(p -f q) but a?^k, b=/k Code lA 

28 , 64 (pq),(k2) . . Code 2 

64 , 28 (k^),(pq) • • • Code 2C 

^3.J6_ (pk),(qk) Code 3 

56 : 32 (qk),(pk) Code 3C 

12 , 15 -MP + k),(q + k) Code 4 

15 , 12 (q + k), (p + k) Code 4C 

11 . 16 (p + q),(2k) Code 5 

16 . 11 (2k), (p + q) Code 5C 



If (for the preceding illustrative examples) a pupil response was not among the 
ones coded above, it was designated either "Code 6" or ^^Code 9" in accord with 
conditions identified later in connection with Table 8 and Table 9. 



If a pupil's observed response on a test item is identical with the criterion 
response for that item, this is no guarantee that distributivity was applied 
by the pupil in formulating his response. Recognition and use of distribu- 
tivity i , alas, not a necessary condition for giving a criterion response. 



When interpreting the data to be presented, certain intra-di strict compari- 
sons may be made validly^ but inter-district comparisons generally are unwar- 
ranted for a variety of reasons. 



Table 5 summarizes for Districts 1 and 2 pupil performance in terms of crj.- 
terion responses. Table 6 (for strict 1) and Table 7 (for District 2) sum- 
marize performance in terms of the more inclusive mathemat icaliy correct re- 
sponses The extremely limited number of observed criterion responses as well 
as other mathematically correct responses, and the related curtailed variance 
of any distribution of such responses, made it senseless to examine the data in 
terms of the factorial design originally planned. Instead, attention was di- 
rected to a consideration of pupils* apparent mis conceptions associated with 
items of the kind investigated. 

Data pertaining to some of these apparent misconceptions are presented in 
Table 8 (for District 1) and Table 9 (for District 2), without regard for Table 
1 factors and levels (other than F, school grade). A more detailed indication 
of the relative frequency of incorrect responses in relation to item character- 
istics is found in Table 11 (for District 1) and Table 12 (for District 2). 
[Information regarding the special case of item 9 is presented in Table 10,] 

A. Each of the following null hypotheses was tested independently with the chi- 
square statistic, where df = (4 - 1) (7 - 1) = 18 and where Hq was rejected 
in favor of (proportions not the same for all grades) at a = .05, for 
which > 28.87. 

Hq: The proportion of observed pupil responses in categories 1, 2, 3, 4, 5, 6, 
9 is the same at all grade levels (4, 5, 6, 7) In a given District for ... 

1. Item type 1113: Regrouping sets context. Left-distributive form. Horizontal 

item-stem format. Wholly-open item-response format. -r 

2. Item type 1123: Regrouping sets context, Left-distributive form. Vertical 

item-stem format. Wholly-open item-response format. 

3. Item type 1213: Regrouping sets context. Right-distributive form. Hori- 

zontal item-stem format. Wholly-open item^response format. 

4. Item type 1223: Regrouping sets context. Right-distributive form, Vertical 

item-stem format. Wholly-open item-response format , 

5. item type 2113: Multiplication-addition context, Left-distributive form, 

Horizontal item-stem format. Wholly-open item-response 
format. 

6. Item type 2123: Multiplication-addition context. Left-distributive form, 

:\ Vertical item-stem format. Wholly-open item-response format 

7. Item type 2213: Multiplication-addition context. Right-distributive form. 

Horizontal item-stem format. Wholly-open item-response 
format. 

8. Item type 2223: Multiplication-addition context, Right-diistr ibutive form. 

Vertical item- stem format, Wholly^open item-response format 



Results :rom t jjse ni l-hypot:hesis tests are sunirarized in Table 13. 

B. Let P (1: ^3,/ i ,J) , instance, be the probability that observed pupil re- 

sponses rr etn ty. s 1113 and 2113 fall in the same category. 
' Each of zm lUllowii- null hypotheses was tested independently for each 
District at . -ch gr^J- level with the Cochran Q statistic^ where df = 4 - 1 
= 3, and vher we,- rejected in favor of (non-equality of probabili- 
ties) at - = ,15, fer which > 7.82. 

Hq(1): P(lli :,2:'J) = F 1213,2213) = P(1123,2123) = P (1223 , 2223) . 

Hq(2): P(1113/:_13) = P 1123,1223) = P{2113,2213) = P(2123,2223) . 

Hq(3): P(lli3,I123) = Pa213,1223) = P(2113,2123) = . P (22 13 , 2223) . 

Thus, for H^(L), paired item-types differ only in their characteristics with 
respect to factor A (Table 1); for 11^(2), paired item-types differ only in 
their characteristics with respect to factor B; and for Hq(3), paired item- 
types differ only in their characteristics with respect to factor C. 

Results from these null-hypothesis tests are summarized in Table 14, 

Further analyses of the data are in progress. 

Some tentative conclusions and conjectures 

. The following observations are believed to be valid for the samples investi- 
gated (which admittedly were not drawn randomly from the school populations in- 
volved) and generally hold for both District 1 (in which a clearly ''modern" 
basal textbook series was used) and District 2 (in which a more or less "transi- 
tional" basal textbook series was used). 

1. As measured by the ability to give criterion responses to examples of 
the kinds tested, pupils' sensitivity to the use of distributivity was rela- 
tively low. The design of the investigation did not enable one to infer whether 
this was due to pupils' simply not "knowing" the distributive idea or to their 
failure to recognize its application in the situations presented in the Tests. 

2. Pupils^ ability to complete correctly examples of the types tested tended 
to increase from grade 4 to 5 to 6 to 7. It is not at all clear to what extent 
this may be accounted for by "opportunity to learn" (a factor which also would 
have a bearing on the preceding observation) . 

3- Acrosis grade levels it appears that "regrouping sets" examples were less 
difficult thsu ^Multiplication-addition" example^., and that "right-distributive" 
examples were easier l^an "left-distributive" examples. These differences, how- 
ever, were i^e-princiipHlly to differences associated with raght- and left- 



distributive forms within the context of regrouping set s (and not within the 
multiplication-addition context) . 

4. Based upon the response categorizations used in this investigation, pu- 
pils had only a limited tendency to respond in the same way across the set of 
examples within a Test (i.e., to have 757o or more of a pupil's responses fall 
within a single category), 

5. The nature of pupils' "incorrect" ("conceptually erroneous") responses 
which fell in categories 2, 3, 4, or 5 seemed to be determined more by the con- 
text of the example (regrouping sets vs. multiplication-addition) or by its 
format (horizontal vs. vertical), and certain combinations of these factor levels, 
than by distributive form (left vs. right). Jk^^ 

6. It is conjectured that the progressive decrease from grade 4 to 7 in the 
relative frequency of category 6 responses is due in large measure to a progres- 
sive decrease in pupils' computational errors, which in turn accounts for the 
progressive increase in category 3 and category 5 relative response frequencies 
for certain factor- level combinations. (A separate examination of individual 
pupil's category 6 responses is being carried out in an attempt to check on this 
conjecture indirectly.) 

Some broader-conjectures are advanced : 

1. Pupils are more sensitive to a conceptual distinction between m sets of n 
and n sets of m than they are to a conceptual distinction between m ^ H 

n X m. 

2. The relationship between m sets of n and m ^ H less well established 
in pupils' thinking than we likely assume it to, be. 

3. The principal factors and levels of interest in this normative investiga- 
tion need to be given more conscious recognition and consideration in the prepara- 
tion of text and related instructional materials, and in the process of instruc- 
tion itself. 

4. Work with properties which give "structure" to some particular aspect of 
mathematics is no guarantee that pupils will be exempt from rote learning and 
"symbol pushing." 
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Footnote 



^One application of distributivity that is found commonly in school mathe- 
matics programs may be illustrated by an exaiiple such as 

23 = (2 X 10) + 3 
-I- ^ = (5 X 10) + 6 

(7 X 10) + 9 = 

where a right-hand distributive form is embedded within a vertical addition 
algorithm. 

For instance, in a recent report by Wiles, Romberg, and Moser (1972) per- 
taining to the learning of addition and subtraction algorithms, one variation 
of distributivity clearly is included (but not identified by name) in sub- 
ordinate pupil behaviors such as 
II 

1. Given the numeral phrase qb + sb, states the sentence qb + sb = 
(q + s)b. [And] 

"2. Given the numerals qb + r and sb + t in expanded notation, 
states the sentence 

q b + r 
s b + t 
(q + s)b + (r + t) tp, 23]/' 

which is the generalization illustrated by the specific example cited at the 

outset. 

In the present investigation interest focused on things akin to 1^, how- 
ever, rather than 2_. 
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TABLE 1 

Factors and Levels Investigated 
WHAT ARE THE NUMBERS?, Tests 01-12, Items 1-9 



Factor 



A^ Context 



B. Distributive form 



C, Item-stem format 



D. Item-response format 



E. Size of common number 



y-. Sjcl ool grade 



Level 

1. Regrouping sets 

2, Multiplication- addition 

1. Left: {k,p), (k,q) 

2. Right: (p,k) , (q,k) 
*[3. Ambiguous: (i, j) , (i, j) ] 

1. Horizontal 

2. Vertical 

** 1 1 . Left-open : a , h ] 

**(2. Right-open: a, b ] 

3. Wholly open: a , b 

1« 4 < k < 10; 1 < p < 10, 1 < q < 10, p + q > 10 

2. 11 < k < 17; 1 < p < 10^ 1 < q < 10, p + q > 10 

*[3. 4 < i < 10, 11 < j < 17; or 11 < i < 17, 4 < j < 10] 

1. Beginning 4th 

2. Beginning 5th 

3. Beginning 6th 

4. Beginning 7th 



Notes. — * Applies to item 9 only, for all Tests, 

** Applies to Tests 09-12 only, for items 1 thru 8. 



EKLC 



TABLE 2 



Characteristics of Test Items Relative to Levels of Factors A, B, C, D, 





Item 


Item 


Item 


Item 


Item 


Item 


Item 


Item 


Item 


Test 


#1 


n 




#4 


#5 


#6 


#7 

..... 


#8 

[ 

















Regrouping sets 






01 


RV 


LH 


LV 


RH 


RV 


RH 


LH 


LV 


AH 


03 


RH 


RV ■ 


LH 


LV 


LH 


LV 


RV 


RH 


AV 


05 


LV 


RH 


RV 


LH 


RH 


LH 


LV 


RV 


AH 


07 


LH 


LV 


RH 


RV 


LV 


RV 


RH 


LH 


AV 


09 


*RV 


*LV 


LH* 


RH* 


*LH 


*RH 


LV* 


RV* 


AH 


11 


LV* 


*LH 


*RH 


RV* 


RH* 


LH* 


*RV 


*LV 


AV 




Multiplication- addition 




Regrouping 






02 


RH 


LV 


u, 


RV 


LV 


RH 


LH 


RV . 


AH 


04 


LH 


RV 


RH 


LV 


RH 


LV 


RV 


LH 


AV 


06 


RV 


RH 


LV 


LH 


RV 


LH 


RH 


LV 


AH 


08 


LV 


LH 


RV 


RH 


LH 


RV 


LV 


RH 


AV 


10 


RV* 


LV* 


*RH 


*LH 


LH* 


RH* 


*RV 


*LV 


AH 


12 


*LV 


*RV 


LH* 


RH* 


*RH 


RV* 


LV* 


*LH 


AV 



Nbtes.-- 

Key for levels of factor B: 1. L = Left-distributive form 

2. R = Right-distributive form ■ 

3. A = Ambiguous distributive form 

Key for levels of factor C: 1. H = Horizontal item-stem format 

2. V = Vertical item- stem format 

All items of Tests 01 thru 08, and item 9 of Tests 09 thru 12 j reflect level 3 
of factor D. For items 1 thru 8 of Tests 09 thru 12, an asterisk (*) at the 
right of a letter-pair indicates level 1 of factor D; an asterisk at the left 
of a letter-pair indicates level 2 of factor D. 

Items 1, 2, 5 and 6 of each Test reflect level, 1 of factor E; items 3, 4, 

7 and 8 of each Test reflect level 2 of factor E. 
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TABLE 4 

Sources of Data 
Tests 01-08 











Number 










District 1 


District 2 




Grade 
4 


Grade 
5 


Grade 
6 


Grade 
7 


Grade 
4 


Grade 
5 


Grade 
6 


Grade 
7 


Participating schools 


2 


2 


1 

•A. 


1 


7 


7 


7 


2 


Classes tested 


7 


10 


10 


9 


17 C 


5^) 18 (, 


3^) 19 


18 


Pupils drawn for data 
analysis f Tests 01-08 


128 


L76 


232 


208 


288 


336 


336 


320 


Pupils per Test^ 


16 


22 


29 


26 


36 


42 


42 


40 



In each of these three classes, some pupils were fourth graders; others 
were fifth graders. 

In each of these three classes, some pupils were fifth graders; others 
were sixth graders. 

In each instance the number of pupils per Test was partitioned as equally 
as possible among the schools from which the pupils were drawn. 
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TABLE 11 



Distribution of Incorrect Responses, District 1 
[Items 1-8^ Tests 01-: B] 



Item characteristics 


due 


Percent of 


resoonses by category 


Context 


Distribu- 
tive form 


I tern- stem 
format 


2 


3 


4 


5 


(• 

D 


Q 

y 










0.0 


7.0 


10,2 


7.8 


47,7 


21,1 










0.0 


10.2 


18,7 


14,8 


31,8 


11.4 






Horizontal 




















6 


n 4 

ft 


IRQ 


X J , o 


o-> 7 


97 9 


9 9 








7 


0,5 


13,5 


13,5 


28,8 


20,7 


10.1 




Left 




4 


1,6 i 


3,1 


4,7 


41,4 


35,9 


10.9 








5 


1, 1 


2,3 


5,7 


51,7 


22.7 


4.0 






Vertical 


6 


2,2 


9,5 


3,4 


45,7 


21,6 


9,5 








7 


2,4 


11,1 


4,3 


49,0 


17,3 


16,7 


Regrouping sets 


























4 


0,0 


7,0 


15,6 


10.2 


46,9 


16 ^4 






Horizontal 


5 


0,0 




19,3 


14,2 


30,7 


10,2 






6 


0,4 


13,8 


13,8 


16,4 


31,0 


7.8 








1 


0.5 


10,1 


10,6 


26,0 


21,6 


5.8 




Righit 




4 


0.8 


7,8 


1,6 


36.7 


35,2 


13, 3 








5 


0^6 


5,7 


2,8 


48, 3 


19,3 


5,1 






Vertical 




3,0 


1 12, 1 


4,7 


39, 7 


17,2 


5,6 








7 


1,9 


' 13,0 


5,3 


40,4 


10,1 


3,4 








4 


0,0 


25,8 


3 1 


7 0 


XI S 

■J 1 9 ■J 


26,6 






Horizontal 


5 


0.0 


/IT 

43,2 


1,7 


9,1 


30, 1 


10.2. 






6 




53,0 


.0,0 


8 2 


22.0 


5-6 








7 


1.0 


58,2 


0,5 


6,7 


17 ;8 


3.8 




Left 




4 


Q 4 


10 9 
, ^ 


n n 




4 9 9 










5 




23,3 


0.6 


29.5 


26.7 


7.4 






Vertical 


6 




33.6 


0.4 


22.8 


21.6 


5 .6 


Multiplication- 






7 


5.3 


44.7 


1.4 


19.2 


17.3 


2.4 


addition 






4 


0..0 


2^ 


5.5 


4.7 


43.0 


24.2 






Horizontal 


5 


0.0 


4]^. 5 


1.1 


8.0 


37.5 


7.4 








6 


1.7 


47.8 


0.9 


7.8 


24.6 


6.5 








7 


1.0 


54.8 


0.5 


7.7 


21.2 


2.9 




Right 




4 


5.5 


15.6 


0.8 


19.5 


43.0 


14.8 






Vertical 


5 . 


9.7 


21.6 


0.6 


27.8 


30.1 


5.7 






6L 


10.3 


33.6 


0.4 


20.3 


20.3 


6.9 








7 


8.2 


40.9 


0.5 


20.2 


17.8 


4.8 



Note, — The "Percent of responses by category" is based upon the total number of 
observed responses which include those in categoiy 1 (mathematically cor- 
rect) at each grade level. 
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TABLE 12 



Distribution of Incorrect Responses, District 2 
[Items 1-B, Tests 01-08] 



Item characteristi 


cs 


















Distribu- 


I tern- stem 




Percent of 


responses b 


y category 


Context 


tive form 


format 


Grade 
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4 


■ 5 


6 


9 








4 


0.0 


6 


11 1 

XX • X 


7.6 


38.5 


34,4 








5 


0,0 


15.2 


10.1 


6.5 


43.2 


17.0 






Horizontal 


6 


0.0 


21.4 


13.4 


14.6 


29.5 


11.9 








7 


0.0 


11 Q 


12 . 2 


27.2 


25.3 


9. 1 




Left 




4 


0.0 


5.2 


1.7 


29.9 


36.1 


26.0 








5 


0.6 


13.7 


3.0 


24.4 


38.7 


14.6 






Vertical 


6 


1.5 


11.9 


3.3 


42,0 


25.3 


9« 2 










2.2 


6.9 


2.8 


51.6 


15.6 


8.1 


?Rie grouping sets 


























4 


0.0 


4. .5 


10.4 


7.3 


43.7 


29.9 






Hot*! »7^r»+"aT 


5 


0.0 


13.7 


9.8 


6.8 


42.9 


17.9 






6 


0.3 


19.0 


11*9 


13.4 


29.2 


12.5 








7 


0.0 


10.9 


10.6 


21.2 


21.2 


7.2 




Right 




4 


0.7 


5.2 


1.4 


32.3 


31.9 


24.7 








5 ' 


0.9 


14.3 


2.1 


26.2 


35.4 


12.2 






6 


1 .o 


11 . J 


J.J 


Jb.U 


z J « z 


9.2 








7 


0.6 


7.5 


2.8 


43.1 


12.5 


6.3 








4 


0.3 


16.7 


3.1 


4.5 


41 7 

^ X . # 


31.9 






Horizontal 


5 


0.0 


35.4 


1.8 


3.3 


37.5 


14.9 








6 


0.0 


47.9 


0.6 


8.0 


26.2 


10.4 








7 


0.0 


47 a 


1 Q 

X . 17 


9 7 


18 1 

XU . X 


7 9 




Left 
























4 


3.5 


13. 2 


2.8 


14.9 


34 4 


29. 9 






Vertical 


5 


5.7 


27.1 


0.0 


12.8 


36.0 


14.3 








6 


6.8 


31.0 


0.6 


21.7 


25.9 


9.8 


Multiplication- 






7 


6.3 


32.2 


0.9 


25.9 


17.5 


5.9 




















addition 






4 


0.0 


16.3 


3.5 


4.5 


41.7 


31.-2 






Horizontal 


5 


0.0 


36.0 


2.7 


3.6 


41.7 


12.5 






6 


0.0 


42.6 


0.6 


8.0 


29.5 


12.8 








7 


0.9 


45.3 


2.8 . 


.12.5 


18.1 


5.0 




Right 






















4 


2.1 


12.8 


2.4 


16.3 


38.9 


27.1 






Vertical 


5 


3.9 


27.1 


0.3 


11.0 


39.0 


14.0 






6 


6.2 


32.7 


0.0 


18.7 


29.8 


7.7 








7 


5.0 


33.7 


0.9 


24.1 


19.4 


6.3 



Note. — The "Percent of responses by category" is based upon the total number of 
observed responses which include those in category 1 (mathematically cor- 
rect) at each grade level. 
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TABLE 13 

Summary of Chi-square Tests of Null Hypotheses, Set A 







District 1 


District 2 


H 

0 


Item 
type 




ixtv*^ >^ <^ Jk A 4 

aBout Hq 




r — : ■, 
i aiiout Hq 


1 


1113 


60,71 






^ D o T p t" 
iCt: J c L 


2 


1123 


40.01 


Reject 


167.81 


Reject 


3 


1213 


67.12 


Reject 


216.16 


Reject 


4 


1223 


69,30 


Reject 


179. ID ! 


, Rtieject 


5 


2113 


100.26 


^ ject 


204.47 ' 


Reject 


6 


2123 


84.91 


teject 


m.2i 


Reject 


7 


2213 


108.18 


te-jject 


222.37 


Rez^ect 


8 


2223 


67.07 


Reject 


173.23 


Reject 



Note.~HQ rejected in f ai^or- of H^^ at a = .05 vsdaHn (for d£ = 
« 28.87. 

For District 1 the eight values of (})• iCramer'rs .statistic, 
bounded by 0 (complete independence) and 1 (complete depend- 
ence)] ranged from .13 thru .22; For Di.strict 2 the eight 
values of (()' ranged from .21 thru .24. 



TABLE 14 



Summary of Cochran-Q Tests of Null Hypotheses, Set B 







District 1 


District 2 




Grade 
level 




Decision 
about Hq 




Decision 
about Hq 




4 


3. 17 


Not r e i e c t 


1.59 


Not reject. 


1 


5 


33.60 


Re 1 ec t 


2 . 72 


Not reje:ct 




6 


. 1.95 


Not reject 


3.28 


Not reject 




7 


6.72 


Not reject 


16.83 


Reject 




4 


0.64 


Not reject 


3.30 


Not rejecit 


2 


5 


12.66 


Reject 


0,74 


Not reject 




6 


0.55 


Not reject 


1.42 


Not reject 




7 


13.62 


Reject 


4.60 


Not reject 




4 


5.66 


Not reject 


2.42 


Not reject 


3 


5 


3.34 


Not reject 


7.02 


Not reject 




6 


2.02 


Not reject 


11.70 


Reject 




7 


7.70 ■ 


Not reject 


7.15 


Not reject * 



Note. — rejected in favor of H^ at a = .05 when (for df = 3) 
I 7,82. 



A simpler gross indication of pupils^ tendency to make the same kind of re- 
sponse across items 1 thru 8 of Tests 01 or 02 or . . .or 08 was expressed in 
terms of the percent of pupils for whom 75% or more of their 8 responses were 
in a single category (1 or 2 or 3 or 4 or 5 or' 6 or 9) . 

For District I these indices of response consistency were 33, 67^ for grsfe 4, 
17.6% for grade 5, 28.9% for grade 6, and 23o6% for grade 7. ■ 

In the case of District 2 these indices were 35.1% for grade 4, 27.4% fer 
grade 5, 27.1% for grade 6, and 24,4% for grade 7. 



k(p + q) = kp + kq 
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kp + kq = k(p + q) 



^ Conmutativity _ 

of multiplication 
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C ommu t a ti vi t y 
of multipri^atlorr 



J 



(p + q)k pk + qk 



A 



>i 0 

0), <d 

0^ 0) 

Ml U 

U rH 

-PI rd 

' 0 



pk + qk = (p + q)k 



Fig. 1. Four equivalent variations of the distributivity of multi- 
plication over addition for counting numbers k, q« . , 



Note. — The variations of distributivity considered in this investi- 
gation are directly or analogously associated with Y and Z of 
Figure 1 rather than with W and X. 



